Papers with metric scores
RETAIN: Interactive Tool for Regression Testing Guided LLM Migration (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly integrated into diverse applications. |
| Approach: | They propose a tool specifically designed for regression testing during LLM migrations. |
| Outcome: | RETAIN (REgression Testing guided LLM migrAtIoN) provides a tool specifically designed for regression testing during LLM migrations. |
The NLP Task Effectiveness of Long-Range Transformers (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing benchmarks on long-range attention models have not been sufficient to develop efficient Transformers and their practical application on complex NLP tasks. |
| Approach: | They propose to benchmark 7 Transformer variants on 5 difficult NLP tasks and 7 datasets to examine their capacity for long-range attention. |
| Outcome: | The proposed models have advantages on content selection and query-guided decoding, but they come with previously unrecognized drawbacks such as insufficient attention to distant tokens and accumulated approximation error. |